Lecture #15 


- Priority Queues 
- Heaps 
- HeapSort 


Priority Queues 


I CAN'T 
BELIEVE IT 


WORKED 
FIRST TIME! 


I CAN'T 
BELIEVE IT 
WORKED 
FIRST TIME... 


Priority Queue 
Why should you care? 


Priority Queues are used to prioritize 
different types of data for processing 
based on their importance. 


They're used in: 
Call answering centers 
Turn-by-turn navigation software 
Operating Systems (thread mgmt.) 
Network packet routing 


So pay attention! 


Priority Queues 


A priority queue is a special type of queue that allows us 
to keep a prioritized list of items. 


Ina priority queue, each item you insert into the queue 
has a "priority rating" indicating how important it is. 


Any time you dequeue an item from a priority queue, it 
always dequeues the item with the highest priority 
(instead of just the first item inserted). 


Example: If I have a queue of 
patients in the emergency room, I 
dont just take the next patient in 

line, I take the one who has the 
most severe injuries. 


Priority Queues 


A Priority Queue supports three operations: 


- Insert a new item into the queue 
Get the value of the highest priority item 
- Remove the highest priority item from the queue 


When you define a Priority Queue, you must specify how 
to determine the priority of each item in the queue, e.g. 


Priority = amount of blood lost + number of cuts 


You must then design your PQ data structure/algorithms 
so you can efficiently retrieve the highest-priority item. 


Priority Queues 


Question: What data structures can we use to implement a priority queue? 


Let's make it easier... What if we have just a limited set of priorities, e.g.: high, 
medium low? 


Hint: Think of an airport ticket line with first, business and coach (cattle) class... 


ptrToHigh Ez 


ptrToMed IE — === 


ptrToLow EE 


Right - we can use n=3 linked lists, one for each priority level. 


To obtain the highest-priority item, always take the first item from the highest 
priority, non-empty list. 


Priority Queues 


Question: Ok, but what data structure should we use if 
we have a huge number of priorities? Hmmm! 


The HEAP data structure is one of 
the most efficient ones we can use 
to implement a Priority Queue. 


The heap data structure uses a special type of binary tree 
to hold its data. 


As well see, while a heap does use a binary tree to store 
its data, a heap is NOT a binary search tree. 


AlI Heaps Use a "Complete" Binary Tree 


A complete binary tree is one in which: 


* All nodes on the bottom-most level must be as far left 
as possible (with no empty slots between nodes!) 


- The top N-1 levels of the tree are completely filled with nodes 


Is it complete (note: these examples are slightly different from the PPT slides)? 
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Heaps... of... 


A heap is a special type of complete binary tree 
(it's not a binary search tree). 


There are two types of heaps, minheaps and maxheaps: 


Maxheap: 


1. Quickly insert a new item into the heap 
2. Quickly retrieve the largest item from the heap 


Minheap: 


1. Quickly insert a new item into the heap 
2. Quickly retrieve the smallest item from the heap 


The Maxheap 


A maxheap is a binary tree which follows these rules: 


1. The value contained by a node is ALWAYS 
GREATER THAN OR EQUAL TO the values of the 
node's children. 


2. The tree is a COMPLETE binary tree. 


Question: What are the 
rules for a minheap? 
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i The Maxheap 


Which of the following are valid maxheaps? 


mms 7 


a null null 6 2 
4 NN FARTAS null null 
== mim mi 


Maxheap reminder: 
1. The value contained by a node is ALWAYS >= the values of the node's children. 


2. The tree is a COMPLETE binary tree. 
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The Maxheap 


One thing you'll notice about a 9 
maxheap is... 


that, by definition, the biggest 7 5 
(highest priority) item TON null. null 
is always at the root (top) == = 
of the tree! | 


This means its easy to always find the 
biggest (highest priority) item in just a single step! 


Operations on a Maxheap 


Allright, now let's see how to extract an item from a 
heap and to add a new item to a heap! 
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Extracting the Biggest Item 


If the tree is empty, return error. 9 
Otherwise, the top item in the tree is 


the biggest value. Remember it for 

later. 7 D 

If the heap has only one node, then TON „nuloj 
delete it and return the saved value. 1 > 


Copy the value from the right-most null nulli null null 
node in the bottom-most row to the 


root node. i 
When we're done, the 
Delete the right-most node in the i 
largest value is on the 


bottom-most row. | 

R top again, and the heap 
epeatedly swap the just-moved value > ; 

with the larger of its two children until IS consistent. 

the value is greater than or equal to 

both of its children. (“sifting DOWN") 


Return the saved value to the user. 
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Extraction Challenge! 
Show the resulting heap after = the largest item! 


12 
X 7 
7 10 gis = 


= 8 4 
3 2 | 8 4 Em E 
— null | null null p ull null [ null null) null null : 
2 2 —— Copy the value from the 
xtract the largest value *— — — -  bottom-most, right-most 
zm from the root node! hele n the "bek Si 
7 10 
an | = 
3 "MN 8 4 [null[null null 
DIU | Compare the new value in the 
root node to the root's two 
children and swap with the 
7 Delete the bottom-most, larger of the two (if required) 
right-most node you just 
copied from. 10 


nul 


2 


null nul] null null 


| null null 


. And we're done! 
Compare the value again to 


the two children and swap The tree is now a valid 
with the larger of the two maxheap again! 
(if required) 


. If the tree is empty, create a 
new root node & return. 7 

. Otherwise, insert the new node 
inthe bottom-most, left-most 2 5 
position of the tree (so it's still TIS null nu 


9 
. Compare the new value with its EMmEMm Ez KATI 


. Repeat steps 3-4 until the new 


Adding a Node to a Maxheap 


(Let's see how to add a value of 9) 


a complete tree). 


parent's value. 


. If the new value is greater than 


its parent's value, then swap 
them. This process is called 
"reheapification." 


value rises to its proper place. 


Wot in reheapification?!?!? 
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Insertion Challenge! 


Show the resulting heap after inserting a value of 9! 


10 
3 4 
3 2 8 4 „= null 
ram null | null null null 
mirm Copy our new value, 9, into 
2 «———————— Create a new node in the EMEN = that new node. 


Emi null null 


left-most, bottom-most 
position possible (to ensure 
our tree stays complete) 


12 
10 
10 
7 2 8 4 
8 4 "am null „null null null 
[null nulli null null z 
3 
| null nul lll nul] null Repeat: Compare our new value 
Repeat: Compare our new value with the parent node's value and 
with the parent node's value and swap if our new value is bigger. 


swap if our new value is bigger. 


A time for vour favorit Il 
vorite game!!!! 
ime for your fa 
nd now, tim 
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l Implementing A Heap 


Question: 
What data structure can we use to implement a heap? 


How about a classical binary Hmmm... But this has some 
tree node with links? challenges. What are they? 


struct node 


{ 


int value: 


node *left, *right: 
Ji 


1. It's not easy to locate the bottom-most, right-most node during 
extraction. 


2. It's not easy to locate the bottom-most, left-most open spot to 
insert a new node during insertion! 


3. Its not easy to locate a node's parent to do reheapification 
swaps. 
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Implementing A Heap 


Perhaps there's some 
better data structure we 
could use... 


Hmmmm. What about an 
array? 


Well, we know that each 
level of our tree has 2x the 
number of nodes of the 


“Mi previous level”. 


A 10 
FÅ = ; So what if we just copy 
3 8 
mm EET PITT rmm our nodes a level at a 
F time into an array??? 


* Except for the last level... 
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Implementing A Heapint count: 


So what if we just copy our 


nodes a level at a time into an int heap[1000]; 
array??? Let' 
et's see, we can put our 0! 12 
root node value in heap[O] 1 7 
2| 10 
And we can put the next 3 3 
two nodes' values into the 
12 next two available slots... 4 e 
2 5| 8 
7 6| 4 
10 And then the next four > 
‘om’ values in the next four 7 
slots... 8 
3 2 8 4 9 
p null nul nul nul Finally, let's use a simple int 49 
variable to track how many 
2 items are in our heap! 1 
nullnuyl i 12 
So the array to the right now logically represents the 13 
tree on the left! And if we use the array, there's no 


need to use a node-based tree! 
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Implementing A Heap nt count: 
12 


a int heap[1000]; 


4. We can add or remove a node by simply setting 


7 
T O 12 
TA 1 7 
3 2 8 4 2| 10 
pon null nul nullnul! 3 3 
2 4| e 
nullinul 5| 8 
So what are the properties of our array-based tree? 6 : 
1. We can always find the root value in heap[O] : i 
2. We can always find bottom-most, right-most node 9 
in heap[count-1] "E 
3. We can always find the bottom-most, left-most 11 
empty spot (to add a new value) in heap[count] 12 
13 


heap[count] = value; and/or updating our count! 
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Implementing A Heap int count. 
12 | 9 | 
in int heap[1000]; 


7 10 
TA Ok, in our array, : = 
; ; z 7 dilaj = we pe MI. 
the left and right 
TA null nul Mi children of a node? 3| 3 
2 
2 1 Let's consider some examples: | 8 
nul iin nul aul 

6 4 
Parent Slot# Left Child Slot# Right Child Slot# 7) 2 
0 1 2 8 1 

2 5 6 9 

3 7 8 


Challenge: Come up with a formula to locate a node's children 


leftChild(parent) = 2 * parent + 1 
rightChild(parent) = 2 * parent + 2 
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Im lementin A Hea int count; 
p'e g P ‘counts 


int heap[1000]; 


10 of 12 
3 2 8 4 2 10 
-- null null mmm mimi 3| 3 
2 
2 1 Let's see, does our formula work? = 5 
mm mum 5 
6 4 
Consider this node, which is in slot #1 of our array? 7 EE 
1 
leftChild(1) =2*1+1 = slot 3 = 


rightChild(1)=2*1+2 = slot 4 
Our formula appears to work! 


Hint: It's of the form leftChild(parent) = 2 * parent + 1 
rightChild(parent) = 2 * parent + 2 


Implementing A Heap int count: 
p g p t court 


int heap[1000]; 


And, due to a 
property of C++ 


So given a node, we can find its two integer division... 


children pretty easily. Cool! 
this formula works 
Question: So now how do we find the slo equally well for both 
left and right 

children! 


i Im lementin A Hea int count; 
p'e g P (2: 


int heap[1000}; 
O 12 ^ 
— y 
3 2 8 4 2 10 


p ww 


Ok, let's verify that it works... EI 4€ 


The parent of slot #1 is... (1-1)/2 = O 
The parent of slot 42 is... (2-1)/2 = 0 
The parent of slot #7 is... (7-1)/2 = 3 


3 

ii, i parent = child-1 : 
null nul! 2 

6 

/ 

8 


2 


Cool stool! So now we know how to locate the children of a 
node, find the parent of a node, and add and remove nodes! 


Heap in an Array Summary 


So, now we know how to store a heap in an array! 


Here's a recap of what we just learned : 


. The root of the heap goes in array[O] 


. If the data for a node appears in array[i], its children, 


if they exist, are in these locations: 
Left child: array[2i+1] 
Right child: array[2i+2] 


. If the data for a non-root node is in array[i], then its 


parent is always at array[(i-1)/2] (Use integer division) 
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A Heap Helper Class 


class HeapHelper main() 


HeapHelper a; 


a.AddNode(123): 
a.AddNode(42): 
a.AddNode(-7): 
a.AddNode(999); 
a.AddNode(314); 


HeapHelper() (num=O; } 

int GetRootIndex() (return(O); } 

int LeftChildLoc(int i) { return(2*i+1); ) 
int RightChildLoc(int i) { return(2*i+2); } 
int ParentLoc(int i)  (return((i-1)/2); } 


int PrintVal(int i) { cout << ali]; } int i = GetRootIndex(); 
i Sys , PrintVal(i); 
= AddNode(int v) (a[num] = v; ++num;) ene 
private: Print Val(i); 


int [MAX ITEMS] 
int num; 


i = RightChildLoc(i); 
PrintVal(i); 


Using an Array to Implement a Heap 


Ok, so now let's see how to use a simple 
array to implement a maxheap. 


To do so, well need to be able to easily do 
the following operations: 


Locate the root node of the tree... Vi 


Locate (and delete) the bottom-most, right- 
most node in the tree... 


Add a new node in the bottom-most, left- 
most empty position in the tree... Få 


Easily locate the parent and children of any 
node in the tree... vi 


Using an Array to Implement a Heap 


Ok, so now let's see how to use a simple 
array to implement a maxheap. 


To do so, well need to be able to easily do 
the following operations: 


Locate the root node of the tree... Vi 


Locate (and delete) the bottom-most, right- 
most node in the tree... 


Add a new node in the bottom-most, left- 
most empty position in the tree... Få 


Easily locate the parent and children of any 
node in the tree... vi 


” Extracting from a Maxheap - 


The Array Version! "count. 


1. If the count == O (it's an empty tree), 
return error. int heap[1000]; 
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2. Otherwise, heap[O] holds the biggest value. 


Remenber it for later. 


3. If the count == 1 (that was the only node) 
then set count=O and return the saved value. 


4. Copy the value from the right-most, 


bottom-most node to the root node: 


heap[O] = heap[count-1] 


5. Delete the right-most node in the 


bottom-most row: count = count - 1 


6. Repeatedly swap the just-moved value with 


the larger of its two children: 


Starting with i=O, compare and swap: 


heap[i] with heap[2*i+1] and heap[2*i+2] 


FO mpHRO DOPO APOD SW VW MO 


7. Return the saved value to the user. 
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Implementing A Heap 


OK, so now let's see how to extract the biggest item 
from an array-based max-heap! 


Then we remove the last node 
from the heap by decrementing 


First, we extract the value 
from heap[O]. 
Since this is the largest 
value in the heap, it should 
be returned to the user! 


Next, we copy the last item in 
the heap into the root of the 


tree: heap[O] = heap[count-1] our count variable. 


: int heap[10]; 
pp Ud int Count; 0 pl i 
: mente, Os MN | 
d LA i 5 „IS 
5 5 
an lama E RE må i 
l 3 1 : 1 He 
4 2 [null null null nul Amd 


7 | int count; Ole 


5 
[null null) 


Next we compare our newly- 
copied value to its two children: 


heap[i] vs. heap[2*i+1] 
and 


„and we repeat this comparing 
and swapping process until our 
copied item is in the right place. 
heap[i] vs. heap[2*i+2] 
We'll swap it with the larger of 
the two children, if necessary. 


int heap[10]; 


= int count; 0 7 
— (= 


5 


mom 


5 
[null null 


null 


= |o vin 


AWN m~ 


4A 0 nm = 


7 Adding a Node to a Maxheap - 


The Array Version int count: 
1. Insert a new node in the bottom- 


most, left-most open slot: . 
heap[count] = value " t heap[10], 
count - count + 1; 10 
1 
2. Compare the new value heap[i] with y 
its parent's value: heap[(i-1)/2] e 8 
3 
3. If the new value is greater than . 


its parent's value, then swap 
them. 
4. Repeat steps 2-3 until the new 


value rises to its proper place or 
we reach the top of the array. 
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Heap Insertion Challenge 


Let's add 12 to our heap. 


First, add the new value to the 
end of our heap array: 


Now, repeatedly compare our new 
value with it's parent and swap if 
our new value is bigger: 


heap[count] = value 


i | 
and then increase our count! if (heap[ i ]» heapt (i-1)/2 D 


then swa 


9 H int heap[10]; 3 int count; 
int count; 3 
a … ag — 
7 5 : d 
p= | null nul 2 == 
1 3 [null nul lE null null 
EEE 
Now, repeatedly compare our new 
value with it's parent and swap if Now, repeatedly compare our new 
our new value is bigger: value with it's parent and swap if 
our new value is bigger: 
if (heap[ i ] > heap[ (i-1)/2 ]) 
then swa if (heap[ 1 ] » heap[ (1-1)/2 ]) 
9 12 . int heap[10]; 
int count; int count; 
: : 12 
Kam (em EE 22 
5 | | 
== im nu 2 -— mim e| 5 | 
3 1 
1 7 1 7 3 
ETUETI oll oul 4 7 Pull nu ll null nul! 4 


Class Challenge 


Show a maxheap and its array after inserting each of 
the following numbers: 


1,6,4,5,0, 8, 3, 12 


Class Challenge #2 


Now show the maxheap and its array after removing 
the biggest 2 numbers: 


= Complexity of the Heap 


Question: What is the big-oh cost of inserting a new 

| | ? 

ENDE heap Every time we insert a new item, we need 

to keep comparing it with its parent until it 
reaches the right spot... 


Since our tree is a COMPLETE binary tree, 
if it has N entries, it's guaranteed to be 
exactly log>(N) levels deep. 


loga(N) 
levels [null null 
So in the worst case, we'll have to do log>(N) 


comparisons and swaps of our new value. (This is true 
whether or not our heap is stored in an array!) 


Question: What is the big-oh cost of extracting the maximum/minimum 
item from a heap? 


Just as with heap insertion, when we extract a value we need to bubble an 
item from the root down the tree. 


Since the maximum number of levels in our tree is log;(N), the worst case 
that this requires log-(N) swaps. 


So inserting and extracting from a heap is O(log>(n)) 
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Alright, one last time today... 


> 


Jage inventor 


> Serial killer 


www maleVolecom 


Heapsort 


sUecess m Å 
CLEAN HEAPSORT 
TODAY. 


Heapsort 
Why should you care? 


Errr... Ok, maybe you shouldn't. 
Heapsort isnt the most popular 
algorithm. 


But it'll probably be on your exam, and 
Il feel hurt if you dont listen. 


So pay attention! 
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The Heapsort 


Question: Answer: 
How can we use a heap to Here's a "naive" 
sort a bunch of items? way to do it... 


Given an array of N numbers that we want to sort: 


1. Insert all N numbers into a new maxheap 

2. While there are numbers left in the heap: 
A. Remove the biggest value from the heap 
B. Place it in the last open slot of the array 


And viola! 
Our array is sorted! 


— Tu oe Si le GS 
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The Naive Heapsort 


Question: 
What's the complexity of our simple version of heapsort? 
Hints: 
What is the cost of inserting an item into a maxheap? 


What is the cost of extracting an item from a maxheap? 
How many items must be inserted and then extracted? 


Insertions: N items * log;(N) steps per item > N log;(N) steps 
Extractions: N items * log;(N) steps per item > N log;(N) steps 


That comes to 2 * N log;(N) total steps, or O(N log2(N)). 


Not bad! But in fact there's an even faster way to use a 
heap to sort an array... Let's see it! 


The Efficient Heapsort 


In our naive algorithm, we took every item from the array 
and inserted it into a separate, brand-new maxheap. 


50 first we built a separate maxheap from scratch, copying 
every one of our items over! 


And then we had to remove each one from our new heap and 
stick them back into our original array. So SLOW! 


Question: 
Could we have avoided creating a whole new maxheap 
and moving our numbers back and forth? 


Answer: 
Yes! That's the way the "official" Heapsort works! Let's see! 


The Efficient (Official) Heapsort 


Let's update our original inefficient algorithm to turn 
it into the efficient (official) version. 


Given an array of N numbers that we want to sort: 


1. Convert our input array into a maxheap 

2. While there are numbers left in the heap: 
A. Remove the biggest value from the heap 
B. Place it in the last open slot of the array 


Wow! It's that simple? Yup! 


We're just going to just shuffle the values around in 
our input array so they become a maxheap. 


Then we'll use that maxheap as if it were a separate array 
like before. Only now everything's in just one array. 


Step #1: 
Convert your randomly-arranged input 
array into a maxheap by cleverly shuffling 
around the values in the array. 


03|9|1|5|4118/21 21518 3049 


A Dy AA 


1 
= or pip a 


Let's learn the algorithm to perform this shuffling. 


"Step #1: Convert Your Input Array into a MaxHeap 


By last node, we mean the bottom-most, right- 
most node in the tree. This corresponds to the 
last element in the array. 


Let's start by 
visualizing our 
array as a 
tree. 


Ok, now here's thé algorithm: 


for (curNode = lastNode thru rootNode): 
Focus on the subtree rooted at curNode. 


Think of this subtree as a maxheap. 


Keep shifting the top value down until 
your subtree becomes a valid maxheap. 


] 
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"Step #1: Convert Your Input Array into a MaxHeap 


Let's start by visualizing our array as a tree. 


Ok, now here's the algorithm: 013|9|1|5|4 


for (curNode = lastNode thru rootNode): 
Focus on the subtree rooted at curNode. 


Think of this subtree as a maxheap. 


Keep shifting the top value down until 
your subtree becomes a valid maxheap. 


"Step #1: Convert Your Input Array into a MaxHeap 


Let's start by visualizing our array as a tree. 


Ok, now here's the algorithm: O0|/|3/9|1|5(4 [1821 


for (curNode = lastNode thru rootNode): 
Focus on the subtree rooted at curNode. 


Think of this subtree as a maxheap. 


Keep shifting the top value down until 
your subtree becomes a valid maxheap. 


"Step #1: Convert Your Input Array into a MaxHeap 


Let's start by visualizing our array as a tr 


Ok, now here's the algorithm: 03 91|1|51|41|18 21 


for (curNode = lastNode thru rootNode): 
Focus on the subtree rooted at curNode. 


Think of this subtree as a maxheap. 
Keep shifting the top value down until 


your subtree becomes a valid maxheap. 
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Step #1: Convert Your Input Array into a MaxHeap 


Let's start by visualizing our array tree. 


Ok, now here's the algorithm: 013|9|1|5|4 


18 


21 


for (curNode = lastNode thru rootNode): 
Focus on the subtree rooted at curNode. 


Think of this subtree as a maxheap. 


Keep shifting the top value down until 
your subtree becomes a valid maxheap. 
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Step #1: Convert Your Input Array into a MaxHeap 


Let's start by visualizing our / 


Finally - we found a subtree 
containing more than one node! 
Let's treat this subtree as if it 

were a maxheap, with a new value 
on top that needs to be sifted 

down... 


Now we simply use our normal 
heapification algorithm to turn this 
subtree into a maxheap. 


fo 


We'll keep swapping our root value 

down with its larger child until it's 

bigger than both of its children (or 
hits a leaf)! 


Rcep-= grepene UNT I 
your subtree becomes a valid maxheap. 


Once we finish, our subtree has 
been converted into a valid maxheap 
(see next slide to see 21 and 1 
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Step #1: Convert Your Input Array into a MaxHeap 


Let's start by visualizing our arrd£ hs a tree. 


Ok, now here's the algorithm: O|3[9 |21/5 [4 |18| 1 


Since 9 is less than 18, we'll 
bubble it down by swapping 
with 18 (see next slide). 


for (curNode = lastNode thru rootNode): 
Focus on the subtree rooted at curNode. 


Think of this subtree as a maxheap. 


Keep shifting the top value down until 
your subtree becomes a valid maxheap. 


Again, let's treat this subtree as a 
maxheap with a new value at the 
top that needs to be sifted down... 


54 


Step #1: Convert Your Input Array into a MaxHeap 


Let's start by visualizing our q5 jay as a tree. 


311821 5149 


Ok, no Ås we can see, 3 needs to be 


sifted down. It'll be swapped 
with 21, since that's the 
bigger of the two children 
(see next slide) 


for (cu 


Foc 
Think? 


Keep g 
your § 


Let's treat this 
expanded subtree 
as if it's a maxheap 

and sift the top 

value down 
appropriately. 
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Step #1: Convert Your Input Array into a MaxHeap 


Let's start by visualizing our array as a tree. 


Essentially what we've done is heapify 
each sub-tree from the bottom-up. 21518 3.0/4 2/1 
As we heapify higher sub-trees, they I'm a valid 
rely upon the lower sub-trees that were maxheap 
heapified earlier! now! 
Once we've finished heapifying from e 
our root node, our entire array will 
hold a valid maxheap! P) ae 
uj (mim maŭ 


m 
H g^ 
| 
| 


56 


Step H1: Convert Your Input Array into a MaxHeap 


There's one more thing to consider! 


If you noticed, we wasted a 
bunch of time looking at single- O 391751418 
node sub-trees. 


But we only had to reheapify 
once we reached a sub-tree 
with at least two nodes. 


Wouldn't it be great if we could 9 
jump straight to this node to m 
save time? 4 la. 
EE mh 


1 
We can - here's how! Er) 21 
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This locates the lowest, right- | Input Array into a MaxHeap 
most node in the tree that has 


at least one child. 


Allowing us to skip all of the 
single-element trees - that's 
roughly 50% of all the 
subtrees! 


013|911|5|4118/21 


startNode = N/2 - 1 oe DE 


for (curNode = startNode thru rootNode): 


Focus on the subtree rooted at curNode. 


Think of this subtree as a maxheap. 


Keep shifting the top value down ati 
your subtree becomes a valid rola 1 
guam 
This is the complete version of 21 
the efficient shuffling algorithm! 
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Efficient Heapsort: Step #2 


While there are numbers left in the heap: 


1. Extract the biggest value from the maxheap and 
re-heapify (just as we learned about 20 slides ago) 
This frees up the last slot in the array 
(since the heap now has 1 fewer value in it) 


2. Now put the extracted value into this freed-up slot of the array. 


-— B. Array after biggest item B.A ft d biggest it 
A. Array after initial . Array after second biggest item 
rah E Fore extracted from the heap and placed extracted from the heap and placed 
in the last slot of the array. in the 2"4 to last slot of the array. 


6351278 


uu OJN 


C. Third 
biggest 5231678 2135678 1235678 
D. Fourth 


item 


processe l E. Fifth 
(3) = biggest = 
item i 
Hem processed 


processed processed 


59 If you think it should 


be O(N log2N), I did 
too. O Come to office 

hours for an 
explanation. 


Big-O of Heapsort! 
Step #1: 


First we take our N-item array Step #1 has a Big-O of O(N). 


(shown here as a tree) and In other words, we can convert 
convert it into a maxheap. a random array into a maxheap 
in just O(N) steps! 


We do this from the bottom up 
by converting successively larger 
subtrees into maxheaps until the 
entire tree has been converted. 


«ie 
Step #2 has a Big-O of 
O(N logzN). 


Why? Each time we remove an item from 
the maxheap, it takes log;N steps. 


Step Ho: We perform this extraction operation N 
times to sort the entire array. 
Then we repeatedly extract = 


the j'^ largest item from the 


Therefore, Heapsort is 
O(N + N log;N), 
which as you know, is just 
O(N logoN). 


maxheap and place that item 
back into the array, j slots 
from the end. 


HeapSort Challenge 


Challenge: Show how to do an in-place heap-sort with the 
following array of numbers. 


slalsfelsfalnje 


Step 1: Show the array after each non-leaf is “sifted 
down" in the array until a valid heap is formed. 


Step 2: Show the array after the first 3 items have been 
removed from the heap and inserted at the end of the 
array. 


(Remember: Sift from j=N/2-1 down-to j=O) 
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Challenges 


Question: Consider a tri-nary tree, where each node has 
three children, represented by an array. Givena node i, 
where can you find its 3 children in the array? Where can 
you find its parent? 


Question: You need to do a fast table search and you also 
need to print out records in alphabetical order. Which 
table ADT will you use? 


Question: What is the big-oh of traversing a binary 
search tree? 

(N)O 'N«€ = 44814 aut 
wou} dn y»oq ADM aut uo 22uo PUD ‘442; 244 Wout dn y20q ÅDM 
2U. uo 22uo 'uMop ADM aut UO 22uo apou Uva LISIA NOA - (N)O `£ 

'p242puo eunjonJ4s DLDP ays JUDM osjo NOA JI op 
UDD NOA 4524 2u4 SI YJIYM (N 60/)O S,4I ‘dow pasoq-1S9 vasn `Z 
€«Jn2,€ = LUDIU ‘Z+und,¢ = DJPPIW 'T«4n2,€ = 442) T 
:SJØMSUV 


